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We consider the problem of defining free energy and other thermodynamic functions when the 
entropy is given as a general function of the probability distribution, including that for nonextensive 
forms. We find that the free energy, which is central to the determination of all other quantities, 
can be obtained uniquely numerically even when it is the root of a transcendental equation. In 
particular we study the cases of the Tsallis form and a new form proposed by us recently. We 
compare the free energy, the internal energy and the specific heat of a simple system of two energy 
states for each of these forms. 
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I. INTRODUCTION 

We have recently [l| proposed a new form of nonex- 
tensive entropy which depends on a parameter similar 
to Tsallis entropy 0- H- and in a similar limit ap- 
proaches Shannon's classical extensive entropy. We have 
shown how the definition for this new form of entropy can 
arise naturally in terms of mixing of states in a phase cell 
when the cell is re-scaled, the parameter being a measure 
of the rescaling, and how Shannon's coding theorem p| 
elucidates such an approach. 

In this paper we shall adopt a more general attitude 
and try to develop the statistical mechanics of systems 
where the entropy is defined almost arbitrarily. Such a 
'designer' entropy may indeed be relevant in a spe- 
cific context, but we shall not justify here any specific 
form. The applicability of the Tsallis form which leads 
to a Levy-type pdf found in many physical contexts is 
now well established 0, 13 an d in the earlier paper we 
have commented about how our form may also be more 
relevant in a context that demands a more stiff pdf. In 
this paper we concentrate on the use of the pdf to obtain 
macroscopic quantities for general entropy functions. 

Central to the development of the statistical mechanics 
of a system is the definition of the free energy, because 
it is related to the normalization of the probability dis- 
tribution function, which in turn controls the behavior 
of all the macroscopic properties of the ensemble. Hence 
we shall first establish a general prescription to obtain 
the free energy, and then determine its value in a simple 
physical case in terms of the temperature for Tsallis and 
the newer form. We shall then use it to get the specific 



heat in both cases and see how it changes with the change 
of the parameter at different temperatures. 



II. ENTROPY AND PDF 



The pdf is found by optimizing the function 



L = S + a(l - Y,Pi) + P( u - 



(1) 



where S is the entropy (whichever form), U the in- 
ternal energy of the ensemble per constituent, pi is the 
probability of the i-th state which has energy Ei, and a 
and (3 are the Lagrange multipliers associated with the 
normalization of the pdf 's pi and the conservation of en- 
ergy. 

Let us make the assumption that the entropy S is a 
sum of the components from all the states: 



(2) 



where <f> is a generalized function which will in general 
be different from the Shannon form: 



S = -(log(p)> = -^p i log(p i ) 

i 

We get from optimizing L 

4>'(p)^a + pE l 
with the simple solution 



(3) 



(4) 
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4>(pi) = (a + (3Ei) Pi 



(5) 
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the constant of integration vanishing because there can 
be no contribution to the entropy from a state which has 
zero probability. 



III. FREE ENERGY 

We shall assume that the Helmholtz free energy A is 
defined by 



0(U-A) = S 



(6) 



Hence if S is nonextensive, and U is extensive, then A 
must also be nonextensive. 
Using Eq.5 and Eq.6 get 



A = -a/ 13 
Hence we get the relation for the pdf 

Pi = xp- 1 (p(E i -A)) 
with the definition 

ip(p) = (j){p)/p 



(7) 



(8) 



(9) 



Here we assume that the function tp can be inverted. 
This may not always be the case for an arbitrary expres- 
sion for the entropy, at least not in a manageable closed 
form. Finally, A can be obtained from the constraint 
equation 



(10) 



Once A has been determined, it may be placed in Eq.8 
to get the pdf pi for each of the states, all properly nor- 
malized, and we can find U and its derivative C, the 
specific heat. For the simple system that we shall be 
concerned with, pressure and volume, or their analogues, 
will not enter our considerations, and hence we have only 
one specific heat, C v , with (3 now identified as the inverse 
scale of energy, the temperature T, 
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(ii) 



so that Eq.10 yields the familiar expression for A 

A=-log(Q)/0 (13) 
where Q is the partition function 



(14) 



The exponential form of pi in Eq.12 allows the separa- 
tion of the A dependent factor and hence such a simple 
expression for A in the case of Shannon entropy, giving 
us normal extensive thermodynamics. 

In the Tsallis case we have 



9-1 

using the q-logarithm 

Log q {p) = 



= -(Log g (pi)) 



(15) 



(16) 



and this is easily seen to lead to, using the symbol e 
for (1 - q) 



Pi 



1 



1 + e0(Ei - A) 



(17) 



We note that as it is no longer possible to separate 
out a common A dependent factor, we can no longer find 
an expression for A in terms of the partition function 
in the usual way. Instead it is necessary to solve the 
normalization equation Eq.10. For a general value of e 
this will give an infinite number of roots, but for values of 
e corresponding to reciprocals of integers, we shall have 
polynomial equations with a finite number of roots, which 
too may be complex in general. We shall later see, at 
least for the simple example we consider later, that a 
real and stable root can be found that approaches the 
Shannon value of A as e — > 0, because in that limit the 
Log q (p) function in the definition of the Tsallis entropy 
also coincides with the natural logarithm. 



V. THERMODYNAMICS OF THE NEW 
ENTROPY 

The entropy we proposed in ref.0 is given by 



IV. SHANNON AND TSALLIS 
THERMODYNAMICS 

The Shannon entropy Eq.3 immediately gives, usin 
Eq.8 and Eq.9 



(12) 



dM{g) ST n r \ 
S= ^f~ = - 2^Pi l °9VPi) 



S with mixing probability 

M(q) = l-J2i 



(18) 



(19) 
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We can also express it as the q-expectation value 

S=-{log(p)) q = J2p 9 i lo9(Pi) (20) 

i 

Proceeding as in the case of Tsallis entropy we get, 
with e = 1 — q, 



The third order difference between W(Z) and log(l+z) 



is only 



and hence the difference between the Tsallis 



form and our form of entropy will be detectable at rather 
low T, i.e. high j3. 



VI. APPLICATION TO A SIMPLE SYSTEM 



p . = e -WME t -A))/e (21) 

where W is the Lambert function defined by 



W(z)e 



W(z) 



(22) 



Like the Tsallis case, here too we have to obtain A by 
solving numerically the transcendental Eq. 10. For the 
specific heat we get 



Let us consider the simplest nontrivial system, where 
we have only two energy eigenvalues ±2?, as in a spin- 
1/2 system. For a noninteracting ensemble of systems 
we shall expect the standard results corresponding 
to Shannon entropy 



A = - log[2 cosh(/?£7)]//3 (29) 

S = log[2 cosh((3E)] - pE tanh(/?£) (30) 

U = -Etanh(/3E) (31) 

C = {/3E) 2 /cosh 2 (pE) (32) 



where we have written for brevity Wi = 
W {e[3{Ei — A)) and have used the following identi- 
ties related to the Lambert function [Tof . 



W'(z) 



W(z) 



z(l + W(z)) 
W(z)/z = e- f W 



(24) 
(25) 



As W(z) ~ z for small z, we see that for small e we 
effectively get classical pdf and thermodynamics, as in 
the Tsallis case. So the parameter e is again a measure 
of the departure from the standard statistical mechanics 
due to nonextensivity. However, our nonextensivity is 
different functionally from the Tsallis form |l|, an d the 
values of e in the two forms can only be compared in the 
limit of low p. If we use the power series expansion of 
W(z) 




FIG. 1: A for Shannon (top), Tsallis with e = 0.1 (middle) 
and Tsallis with e — 0.25 (bottom) 



W(z) = J2 



(26) 



and compare that with the power series expansion for 
log(l + z) in a form of the Tsallis pi similar to the new 
entropy form 



p . = g-loga+er^B.-A))/^ 



(27) 



we get a cancelation of the parameter e„ of the new 
entropy and of Tsallis parameter ex in the first order, 
so that both distributions approach the Shannon pdf, as 
we have already mentioned, but if we demand equality in 
the second order, we get 



1 



(28) 




FIG. 2: S for same three entropy forms (from bottom to top 
Shannon, Tsallis (0.1), Tsallis (0.25)) 

For the Tsallis entropy we shall take e = 0.25, 0.10 and 
solve numerically. The values are shown in Figs 1-4. It is 
seen that Tsallis entropy gives very similar shapes for all 
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the variables and for e = 0.10 we get a fit much nearer 
to the Shannon form than for e = 0.25. 

The specific heat shows the typical Schottky form for 
a two-level system. 




FIG. 5: Comparison of A for Shannon (apart), Tsallis with 
e — 0.1 and new entropy for e = 0.05 (superposed) 



FIG. 3: U for same three entropy forms (same order as for 
S) 



c 




FIG. 4: C for same three entropy forms (peaks bottom to 
top - Shannon, Tsallis (0.1), Tsallis (0.25)) 

Though the variables involve both p + and p_, after 
finding A we can replace p- by 1 —p+ for faster execution 
of the numerics. 

For our new entropy too we first find the numerical 
value of A from the normalization condition 

e -W+/e + e -W-/e = 1 (33) 

and then use this value to find U, S, and C. In Figs. 
5-8 we show the values corresponding to e„ = 0.05, which 
is half the Tsallis parameter ct = 0.10 used, and also the 
Shannon values. We note that only for the S curve we 
have a perceptible difference between Tsallis entropy and 
our new entropy at values of (3 near 1 . 

VII. CONCLUSIONS 

We have presented above a simple prescription for find- 
ing the important thermodynamic variables for any given 
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FIG. 6: Comparison of S for same three forms of entropy 
(Shannon, Tsallis (0.1), new entropy(0.05) - Tsallis is just 
over the new entropy ). 

D 




FIG. 7: Comparison of U for the same three entropies. Shan- 
non is separated, other two overlap. 



form of the entropy as a function of the pdf's of the 
states. We note that despite the apparent complexity 
of the exponential or transcendental equations determin- 
ing the primary variable, the Helmholtz free energy A, 
it is possible to numerically get stable values which ap- 
proach the expected Shannon values in the right limit of 
the parameter used, both in the Tsallis case and in our 
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FIG. 8: Specific heat C for same three entropies. Again, only 
Shannon is separated. 

case of the newly denned entropy. For higher values of 
the parameter our entropy would give values varying sig- 
nificantly from the Shannon or even the Tsallis entropy, 
and there may be physical situations where that may 



indeed be the desirable characteristic. But at low val- 
ues the corresponding values of the parameters for the 
two distributions produce virtually completely overlap- 
ping graphs. The form of the entropy may be a reflec- 
tion of the effective interaction among the constituent 
systems of the ensemble, the Shannon form being the 
limiting case of the zero interaction case, and Tsallis or 
our form being results of different forms of interaction 
with e standing for a coupling constant. It may be inter- 
esting to investigate more complicated systems that are 
physically realizable and comparable. It is noteworthy 
that most thermodynamic functions we have considered 
here are not crucially dependent on the form of the en- 
tropy with adjusted coupling, though the value of entropy 
itself may vary significantly in the different formulations. 
This probably indicates that the best way to discriminate 
between the suitability of different definitions of entropy 
in different contexts may be in comparing quantities that 
relate most directly to entropy. 
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